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ABSTRACT 


The method of [1] for obtaining an approximate lower 
100(1l-a)% confidence limit on System Reliability is used, except, 
instead of a Gamma probability distribution, a Normal probability 
distribution is used as the underlying distribution for §, the 
estimator of the negative natural logarithm of system reliability. 

An investigation is made of the artare involved in the 
truncations and approximations used throughout the development. 

A continuity correction factor is developed, and confidence 
limits on system reliability, resulting from computer simulation, 
are presented both with and without the inclusion of this con- 


tinuity correction factor. 
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1. INTRODUCTION 


An ad hoc procedure for obtaining an approximate confidence 
interval for system reliability has been developed, based upon 
Bernoulli test data from unequal samples of the various compo- 
nents of the system [1]. Integral to this procedure is an 
assumption that the unbiased estimator of the negative natural 
logarithm of system reliability may be approximated by the 
Gamma probability distribution. It was the purpose of this 
thesis to (1) investigate the errors in the above mentioned 
procedure (hereafter called the Woods-Borsting Method) resulting 
from truncation and approximation; (2} develop a different corm 
fidence interval, using the same ad hoc procedure, but assuming 
an underlying normal probability distribution, vice Gamma, on 
the unbiased estimator of the negative natural logarithm of 
system reliability; and (3) compare the confidence limits 
resulting from both procedures for various values of the para- 
meters involved. 

That the investigation which follows was ever undertaken is 
primarily justified by the results obtained under the Gamma 
distribution assumption. As will be explained below, the one 
percentile of the simulated distribution of the lower confidence 
limit, call it Rs (a)? and true system reliability, Re» should 
be the same; hence, the absolute value of their difference can 
be used as a measure of the accuracy of the Woods-Borsting 


Method. In one case the magnitude of this difference was .18 


and the average difference was .036. The above figures, coupled 
with the realization by the author's of the need for error 
analysis, motivated the undertaking of this thesis. 

Although any one of several probability laws could have been 
chosen to supplant the Gamma distribution used in the Woods- 
Borsting Method, this investigation is limited to only one, the 
normal distribution. If we write the negative natural logarithm 
of system reliability as -ln Ro and define this quantity,: for 
simplicity of notation, to be identically equal to S, then it 
will be seen below that two sources of error are directly related 
to §. The first is an error of truncation of an infinite series 


expansion of ln R The second is an error of approximation in 


s° 
the expression for Var (8), where § is the unbiased estimator 
fore 

Error analysis is performed on the former, but not on the 
latter, because it is felt that, due to the complexity of the 
expression dropped in the approximation, this would, in itself, 
be subject matter sufficient for a thesis. 

In the following sections, the necessary background is first 
presented, which includes an explanation of the Woods-Borsting 
Method, the investigation of the two above mentioned errors, the 
formal introduction of the normal distribution assumption, and 
the mathematical development of a new confidence interval based 
On this assumption of normality. 


In Section 3, the lower confidence limit, taken from the 


confidence interval, is seen to a function of random variables, 


and hence has some underlying probability distribution. This 
probability distribution is simulated by digital computer, the 
shape of the distribution, and the reasons therefor , are 
discussed, the results are presented in tabled form, and com- 
pared to the results of the same simulation of the Woods-Borsting 
Method. It will be seen that the results are in need of improve- 
ment, leading to Section 4. 

In Section 4, a continuity correction factor is developed, 
necessitated by the fact that s, assumed to be a continuous random 
variable, can, in reality, take on only discrete values. This 
continuity correction factor is then incorporated in the con- 
fidence limit, the distribution of this new random variable sim- 
ulated, the results tabulated, and comparison made to both the 
results of Section 3 and the Woods-Borsting Method. 

In the last section, a summary comparison is made, in a con- 
densad tabular fons Jaca in the text, of the results of the pre- 
ceding two sections, the Woods-Borsting Method, and a well-known 
method of estimating system reliability when all component sample 
sizes are the same, based on the Poisson approximation to the 
Binomial distribution. Conclusions are made as to the accept- 
ability of the Normal assumption over the Gamma, and to the 
extent to which the addition of the continuity correction factor 
increases the accuracy. 

Ever since automation and advancirg technology began to 
increase the complexity of various equipments, particularly 


military weapons systems, the purchasers, and consequently the 


ll 


producers, of these equipments have become increasingly more 
aware of the necessity for predicting the overall reliability 

of these equipments. Many problems in the mathematical theory 
of reliability have been solved, but one that has not is that 

of obtaining a confidence interval on system reliability when 
the reliability of the system is to be computed as the product 
of the various component reliabilities, and the sizes of the 
test samples taken of the various components are not all equal. 
If component sample sizes are all equal, there exists a well- 
known method of obtaining a confidence interval on system re- 
liability, based on the Poisson approximation to the Binomial, 
as explained in [1], p. 2, and [3], pp. 218-219. However, when 
one considers that components of complex systems are being built 
by different sub-contractors in different geographical locations, 
that these components are not mass produced, rather only a rela- 
tively small quantity cf each are ever manufactured, and that 
samples are drawn for reliability testing before the whole system 
is ever assembled, then the only conclusion is that sample sizes 
of components will rarely be the same, except by accident, not 
design. Hence, there is a definite need for a method of obtain- 
ing a confidence interval on system reliability, based upon 
varying sample sizes of components. Using the work done in [1] 
as a foundation, this thesis is an attempt to move toward the 


solution of this problem. 


2. BACKGROUND 


In this section the Woods-Borsting Method is explained and 
the mathematical development shown, errors in the Woods-Borsting 
Method due to truncation and approximation are pointed out and 
investigated, the assumption of an underlying normal probability 
distribution for §$ is introduced, and the lower 100(1l-a)% confi- 
dence interval (where @ = PL type I error }) based on the normal 


assumption is developed. 


EXPLANATION OF WOODS-BORSTING METHOD 
In a system with k components connected in logical series, 
the true system reliability, Ro» may be expressed as 
k 


R.= II p (1) 
trad i 


ee component, whether 


where Py is the true reliability of the i 
the component be continuous operating or cycling type. Com- 


ponent reliability may be expressed in terms of unreliability, 


yi 
a a (2) 
and hence k 
at qt = q,) (3) 
Define 
k 
g = -InR, = -) Im (1 - 4,) (4) 
i=l 
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and, expanding the natural logarithm in an infinite series 


s=-)U-a) -#C- ap FC - ap® eof 


i=1 
j 
k foe] 
- y ie (5) 
j 
i=l j=l 


which may be approximated by the first two terms of the series, 


called - for ease of expression. 
Me 
; (6) 


It is shown in Section 2 that the error due to truncation is 


~ 
be ~° 
it 


quite small; in fact, 


k a, 
se )n, ‘sarap (7) 
i=l i= 


It can be shown (see Appendix I) that an unbiased estimator for 


Tj> call it T is 


i’ 
A2 
“A AN qs 





where 
2n.- 5 
eel operas (9) 
4 2(n,~1) 


(10) 


i n-7L 


(11) 


> 
i 
7h 
bode ° 
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a being the number of units of component i that lived out their 
assigned mission time during a test, and f. the number of failures 


of type i observed during the test. Therefore 


Sm) 2, (12) 


is an unbiased estimator of S. An approximate value for the 


variance of $ can be shown to be (see Appendix II) 


k As aay 
Var(S) = ) Var (T,) = ea (13) 
i=] i=l 
Thus, we have the first two sample moments of the random variable 
“A 
Se 
Next, a two-parameter Gamma distribution is fitted to § by 


the method of moments. If the density of $ is taken to be in 


the form 
rol 
x__exp(-x/®)_ 5 x > 0, r > 0, 0 >0 
r (r) 0” 
£a(x;r,98) = (x) 
S 
0 otherwise 


then 
AN 
ELS] = 6r =S§ 
k su 
var(8) stg 
i=] 


Solving these equations for r and 0 


r -(3,) Po i 


i=] ion 
oS | Sr 
isl 2 i=] 
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and thus an estimator t, for r is taken as 
(fH)? / OY) 
Oks 7 


i=l i=l L 
Since § is assumed to be Gamma-distributed, 28/6 is distributed 


T 





approximately x2 e Thus 
2r 


A 
‘- 22, 2 | 
mid »| 2 Xt - a, 2r 


20 2 
=PiO0rssg X 
l- @, 2r 





aunt: 2x § 
= Pp 7 LE 
S x2 
l- a, 2r 
th ; ea 
Where X is the @ percentile point in x %distribution. 
l- @,2r 2r 


2 
If r 2 3 and @ is small, the quantity 2r/x is 
l-a,2r 


almost a constant with respect to r. ...consequently, 


the random variable 2r/, , will have small variance 


l-a,2r 
eee Thus, from this last equation... [1] 


a A m 2 
= Pi-ln Re < § L2r . 
; S [ 1 / x w [22] 


Ly Se exp & § rat) / 2 ) 


l- o,C2r] 


~ 
i 
R 
t 


where [2r] denotes the smallest integer greater than or equal 


24 “wor > , 
i, GY: ie ~fyh, Ye tal ee See Pee ee ss Le a eee at 253 182i tate re ON 
RET Mie o ler ORE ee a a lena 


to 2r. The right-hand side of the probability statement is 
therefore the lower confidence limit of the Woods-Borsting 


Method, call it R » and 
LC. 
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n= exp(-S2t]/2 sid) 
a 1- a,[2r] 


ANALYSIS OF THE ERROR DUE TO TRUNCATION 
In the transition from (5) to (6) an infinite series was 


truncated to its first two terms. Examine the inner summation 


Se 
q 

ya oy rok +) = (14) 

j=l j j=3 


of (5) 


= Dn tf R, 
where Ro is the remainder of the series after two terms have 
been written out. If we test the ue and (n + 1) 5¢ terms of 
this series by the ratio test, 


mt ft 
1 - 


calli tn ee (15) 


qg® / n n+l 
i 


we see that this expression is always less than Vie 1, which 





implies the series is convergent. Then by Theorem 24, p. 328 
of (2). 


nq 
ie) ei (16) 
eae 
which implies that 


RS emo, r=4, (17) 


Since r2q_, let us choose r ® le 1 so as to make R, as small 
i 


as possible 
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z ntl (1 
RA 4, (nt+1) (1-q,) (18) 
and evaluating at n = 2 
3 é 
ROS 4, / 3(1-4,) (19) 


Since a << 1 in most cases of interest, choose q, = .15, for 
example, which is about the largest value it will ever take on, 


and we see that R= 1.4 x 1073. Substituting equation (19) into 


\" sures le i icissian (20) 
j=l aie. 


and substituting (20) into (5) 


k 
S < Ney, if a,3/ 3(1-4,)) (21) 
i=l 


which upon distributing the summation sign becomes equation (7). 
For ie 005, still quite a large value for q,; to take on, and 
k = 15 

k 


Ae s < DB +6x 107 ; (21a) 
i=l 


so the approximation 
k 
ss rt, (6) 
i=] 
is quite good. 


INVESTIGATION OF ERROR DUE TO APPROXIMATION IN Var (8) 


In Appendix II the Variance of the random variable S is com- 


puted, and it is seen that the value used in (13) above differs 


18 


from the true variance by a factor 


em (1s ee 
2C 2(n,-1) i’ n, oni 5 “4, (22) 


Upon embarking upon an investigation of the size of this term 
it is quickly seen that it is a task which, due to the amount 
of work involved, is beyond the scope of this thesis. A few 
general comments on this term are in order, however. 

Being a function of both the ce and n> equation (22) may, 
for certain combinations of these parameters, actually be less 
than zero and reduce the variance of §, In order to determine 
when this Occurs, it would be necessary to use a digital com- 
puter to compute and plot for each set of n> i=l, **°, k, a 
curve over the range 0 s q,5 1; and, similarly, to compute and 
plot for each set of qi» i=l, °*°°, k, a@ curve Over the range of 
2Sn 


interest of n SN, where N might be 150. 


i 

If the summand of (22) is plotted as a function of a single 
q > with the 2 held fixed, the curve is seen to be bell-shaped 
Over the range 0 S$ q $ 1, but within the realistic range that 
op may be expected to take on, 0 $s q.s el5, (22) is a non-de- 
creasing function, and strictly increasing unless a point of 
inflection occurs. 

If the summand of (22) is plotted as a function of a single 
sv where n. is of course integer-valued, it is seen to be a 
monotone-decreasing step-function, asymptotic to the n, axis. 


As a crude bound, on the size of the error, consider the 


summand of (22) 
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3q 2 
q.2 i y 
it 1 + - 2q 2 - 2q 
2(n, -1) n; i i y (23) 
<4 1 + 2207-120 } 
2n, ny i i (24) 
3q,2 
ee met ee 
> (25) 
Si 
f 3 
a ta 
2n 1 ny (26) 


aan implies that 


Sloot 


i=] 2(n, 1) 








- 2q, ue 2 ha tay US can 


which is obviously not a least upper bound, but an example is 


informative. Let n = 20 for all i, and k = 15 


< Ll 
ae i (28) 
is 


which admittedly is of an undesirable magnitude for an omitted 
term, but (22) is undoubtedly much less than .4. 

INERODUCTION OF THE NORMAL DISTRIBUTION FIT FOR § 
AND DEVELOPMENT OF THE ASSOCIATED CONFIDENCE INTERVAL 

Now, instead of a two-parameter Gamma distribution as was 
used in [1], assume that the distribution of § can be fitted by 
a Normal distribution with parameters and o 2, The prob- 


A 
ability density function of § is therefore 


20 





2 
: exp (- > ¢ #B eo 10 


o J ail 


0 otherwise 


£ (xi, ) = (29) 


Again using the method of moments, 


e[$] == Ss = - Ink. 


P 2 qT; (30) 
Var(S) =o =» ages 


Let 





k 
A 2 L 
= 4 Y E (31) 





-) ela] (32) 


k 
orn 
n 


ist ? 





and @ 2 ig an unbiased estimator of o 2 - 


Now, based upon the normality assumption on S, 


“A 
l-a=p[ 2 2-8 J (33) 





Where Ky is the ordinate of the tabled standard normal distri- 
bution exceeded with probability a . Multiplying by -l, 


equation (33) becomes 


“A 


ed od 2 ec 3 Cw (34) 
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which may be approximated by 
; A A 
l-aw*p[sss+Ko] (34a) 
N 
= Pp Ls Ss Sy (a) J 


if SG is the square root of the unbiased estimator of go. Since 


5? was seen to be unbiased, let 


Te 
g-J8? = [)) (35) 





n 
iz. 1 


Putting in the values for S and GO in (34a) 


—_ 
f 
R 
] 


(36) 





which is an approximate lower 100(1l- a)}% confidence interval on 


R.. The associated lower confidence limit, call it R 


s sia)’ *§ 


(37) 





Substituting equations (8) through (11) in the above express- 


ion, the result is 


k 2 
a.f. b,f; 
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which is a random variable whose distribution is unknown, 
although it is a function of the Binomial random variables 
fi» i= 1, ***, k and the parameters n; and k. Thus, to 
evaluate the worth of this confidence limit it is necessary 


to simulate the distribution of this random variable. 


23 


3-2 SIMULATED DISTRIBUTION OF CONFIDENCE LIMIT AND RESULTS 


In this section the digital computer simulation of the 
distribution of S 7 Ky G is explained, as is the method of 
testing the accuracy of the results of this simulation. 
Several histograms of the computer-simulated distributions 
are presented in Figures 1 through 4, with a discussion of 
the shapes of these histograms. The results of the computer 
simulation are presented for ten different combinations of 
the input parameters in Table I and these results compared 


with the same cases of the Woods-Borsting Method in Table II. 


SIMULATED DISTRIBUTION OF THE CONFIDENCE LIMIT 
AND MEASURE OF ACCURACY 


In order to simulate the distribution of the confidence 
limit, the input parameters k, n,, i= 1, ***, k, and 
P, = 1 - oe i= 1, *°*, k are chosen and used as inputs 


to be computer program. The values chosen are given in 


Table I. Using true values, the following are computed 


in order that they may be compared with the simulated 


values: 


24 


R, = Il p (1) 
oe + 
a? 
Tq eg, Eee 5k (39) 
ii 2 
k 
= \'ts (6) 
i=] 
a 4 . 
S n Ro (4) 
k 
ay i 
a, (40) 
i=l 


Note that S is computed two different ways in order to see the 
effect of the truncation of the logarithmic series. 

Next, the simulated values are generated by the program. 
A three digit random number is obtained using a uniform random 
number generator subroutine. If the random number is greater 
than Py» a failure is "counted" by the computer; if the random 
number is less than or equal to p;, no “count" is made. This 


random number generation is done n, times for each Pie Thus 


i 
the number of failures counted divided by the number of units 
of that component becomes and estimator of unreliability for 
that component; i.e., 

f 


4-— 
, Mn. 
1. i 


(11) 


The whole process is repeated k times, giving an estimator for 
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each qd.° Several arithmetic operations are performed by the 
computer with these q, resulting in computation and storage for 


further use of the following simulated values: 





x2 
, te 
T, = a, q. + 5 (8) 
k 
a A 
g=)'T, (12) 
i=l 
(41) 





In order to complete the simulation of the distribution, it 
was decided to make 500 replications of the above procedure. 
Thus 500 values each of (12) and (41) are computed and combined 


in the form 


k 


gs \'Ty +K, 
Uy i im 





(42) 


for each value of @ Three values, .05, .10, .20, were chosen 
for ©. The 500 points of the distribution were then sorted, 

by size, by a separate subroutine. The distribution was printed 
Out in its entirety in order that a frequency histogram could be 
plotted, and the oa percentile of this distribution, call it A, 
“A 


was found by the computer. Then e “ was computed and printed 


out for comparison with true system reliability, Roe 
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Consider the underlying meaning of the probability state- 


ment 


PL Ro? R J=l-a (43) 


S,L(q) 
If the probability density function of Re L(a) is plotted on a 

P 
coordinate system, and Re is taken to be a point on the abscissa, 
then (1 - @)% of the area under the curve lies above and a % lies 
below R,. Therefore, Ro should be equal to the qth percentile of 


Ss 


the distribution of Re L(o) which we have called exp(-A) above. 
b 


Thus 
| Ro~ exp(-A) | (44) 


is a measure Of the accuracy of the procedure under investi- 
gation. This difference is shown in Table I for all cases 


simulated. 


DISCUSSION OF SHAPE OF DISTRIBUTION 

As will be seen in Table I, ten different combinations of 
the parameters k, Ni» and Pp. were selected for computer simu- 
lation; for each of these ten combinations three values of a, 
-05, .10, and .20, were used, for a total of 30 different dis- 
tributions simulated. Four of these 30 were chosen as illus- 
trative of the effect the parameters have on the shape of the 
distribution, and are included as Figures 1 through 4. In all 
cases illustrated a = .20 and k = 15, except Figure 2 where 


k = 13. All the figures utilize class intervals of width .025. 
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(0) 11, 63 


Ajuonbei gy 


All four are skewed right in varying degree, having greater 
than 50% of the area below the mean. 
In Figure 1, the a are all equal as are 14 of the 15 Dis 


The remaining Py, PL. = -85, is considerably lower than the 


15 
rest. In this case, six of the 12 class intervals in the 

lower tertile have zero frequency, and these six are not 
adjacent, rather are interspersed with class intervals of high 
frequency. Overall the distribution is multimodal and and has 

a range Of .8868. The standard deviation is .136. 

In Figure 2, both the n, and p, vary greatly, 5s ns 150, 
.900 s P.s ~995. This distribution is unimodal, and, except for 
an atea between the 87°? and gg th percentiles, approximates a 
right-skewed bell-shaped curve. The range of the distribution 
is .9545, from .108 to 1.0625; the standard deviation is .153. 

All P, are equal, but the n; vary greatly, 15 s ns 250, 
in the next case, shown in Figure 3, The distribution is 
unimodal, and closely approximates a bell-shaped curve, with 
a slight degree of skewness to the right. Here is the smallest 
range, .3696, and the smallest standard deviation, .06, of all 
distributions simulated. 

The last case displayed, Figure 4, has relatively small 
values for the P.> -95 for the first 14, and .85 for the 15%, 
The n, are all equal to 20. This distribution is erratic over 
its entire range, the class intervals alternating from low to 


high frequency. The range of the distribution is 1.4063, but 


it is interesting to note that the distribution is shifted much 
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further to the right on me Sica axis than the previous dis- 
tributions, its lowest value being .525l1. This distribution 
also shows large dispersion about its mean, with a standard 
deviation of .232. 

From these form illustrative cases, coupled with an analysis 
of the other 26 cases which are not graphed, some general con- 
clusions as to the shape of the distribution can be made. As 
the P; decrease in value, the range of the distribution increases 
and the distribution shifts to the right on the § abscissa. 


U(q) 
If the P, are varied instead of constant, the dispersion of the 
distribution about its mean is larger. If the a are varied, 
the distribution can take on a larger number of discrete values 


within its range, and the distribution becomes unimodal. 


RESULTS 

The results of the 30 cases, ten different combinations of 
the parameters k, n> and P, for each of three values of @, are 
presented in Table I below. In Table II, the results are com- 
pared with the Woods-Borsting Method. 

Column (1} of Table I is self-explanatory. The headings 
of the rest of the table have been previously defined above, 
but are reiterated here for use in referring to the table. 
Column (2) is the number of components in the system. Column 
(3) is the size of the sample tested for each component of the 
system. Column (4) is the probability of success for each 


component of the system. Column (5) is the system reliability 
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based on the input parameters of columns (2) through (4). 
Column (6) is the value of a@ which divides each case into 
three parts. The mean and variance of the distribution of 

$ + Ky G are shown in columns (7) and (8). Column (9) is the 
exponential of the oth percentile of the distribution, and 
column (10) is the difference between columns (9) and (5), 
the measure of accuracy of the procedure. 

In Table I, cases 1 and 6 are identical except that the 
number of failures, f were generated by the computer using 
different entry points to the random number generator sub- 
routine. Comparing the values of | exp(-A) “Ro | for these two 
cases, it is seen that they are the same for a = .05 and 
a= .10, and differ only in the third decimal place for a = .20. 
Therefore, it appears that 500 replications of each case is 
sufficient to Overcome random fluctuations in the numbers gen- 
erated, and it was to investigate this area that these two 
cases were chosen identically. In reading Table I, one should 
compare cases, 1, 6, 9, and 10, as 9 and 10 differ from 1 and 
6 only in choice of one of the n,; and 9 and 10 differ from each 
other only in the P, with which this one different n. is asso- 
ciated. Case 8 is also comparable to the above four cases, the 
difference here being that the n, were increased from 20 to 50 
for all i, which appreciably increases the accuracy of the pro- 
cedure. The results of cases 4 and 7 should also be compared 
as they differ only in the choice of nN,» and again it is seen 
that the larger the n,, the better the accuracy, all other things 
being equal. 
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To see the effect of the P; on the accuracy of the procedure, 
consider cases 3, 5, 6. In case 3 the average P;> call it 
P, = .9702; for case 5, P, = .9433, and in case 6, P, = .9853. 
At the a = .05 level, the accuracy improves as P, decreases, 
which is as it should be. As the P, decrease the qs increase, 
and thus when the random number generator subroutine computes 
Eis the number of failures, there exists a greater number of 
discrete values f. can take on, hence a correspondingly greater 
number of values § + Ky G can take on in the lower tail of the 
distribution. It is therefore more likely that the 5th per- 
centile of the distribution will be close to R.- In general, 
the worst results are for the distributions in which @ = .05 due 
to the sparsity of different discrete values the distribution 
can take on. 

In general, the results were not too satisfactory. In 
only five of the 30 cases was exp(-A) within .01 of the true 


system reliability, R_. Of considerable importance is the fact 


S 
that in every case the difference exp (-A) -R,, was positive indi- 
cating that the values of A, the on percentile of the distri- 
bution, were too small. This led to the addition of a continuity 
correction factor, developed in Section 4, to compensate for the 
fact that S, in reality a discrete random variable, was fitted 
by a continuous probability distribution. 

Table II compares the above results with the results of the 


Woods-Borsting Method. Columns (1), (2), (3), (5) and (7) were 


used in Table I, and are identical in definition here. Column 
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(4) is the oth percentile of the distribution R of [1], and 
column (6) is a measure of the accuracy of the Woods-Borsting 
Method. Table II does not include all the cases simulated in 
[1], rather only those which are identical to the cases of 
Table I. As mentioned in the Introduction, the average error 
in the Woods-Borsting Method was .036 for all cases simulated. 
The average of column (6) is .032 while the average of column 
(7) of Table II is .03, so at least based on these average 
error figures the fitting of a Normal distribution rather than 
a Gamma, to § appears to be slightly better, but not signifi- 
cantly. 

The cases of principal interest are those where component 
sample sizes differ, since this is the problem the procedure 
was designed to cope with. These are cases 3, 4, 7, 9, and 
10. The average error for these cases under the normal dis- 
tribution assumption (column (7)) is also .03, so it appears 
to be no better or no worse for varying sample sizes than for 
constant sample sizes, based upon the few cases presented in 


Table Il. 
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4. SIMULATED DISTRIBUTION OF CONFIDENCE LIMIT WITH CONTINUITY 
CORRECTION FACTOR, AND RESULTS 


This section is devoted to a heuristic development of the 
continuity correction factor mentioned above, a presentation 
in Table III of the results of the same ten cases with the 
correction factor included, and a comparison of these results 


with the results of the Woods-Borsting Method. 


DEVELOPMENT OF CONTINUITY CORRECTION FACTOR 


Since § is a random variable able only to take on discrete 
values, but was assumed, in (29), to be a normal random variable, 
a continuity correction was deemed necessary. Consider (8), in 


which (9) through (11) have been substituted 


= 2 
es any 3 fi : ny £ i 
5 & : Gg. Ew wees 3 Oo eee =e (ed 
i = 2(n, -1) i 2(n,~1) n,2 
; (45) 


(Qn, - 3) f. ee 





2n, (a, -1) 


For every possible number of failures, 0 < fs ni» ts assumes 

a different value, and if these values were plotted on the 

real line, the size of the interval between adjacent values 
would vary due to the nature of ee It was felt that, just 

as in the Normal approximation to the Binomial (where the 
continuity correction factor roe » 1f£ n is the sample size), 


2n 
the continuity correction factor should be related to the size 
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of the interval. Toward this end define 





2 
T f cd ° Cae) T ri : SS (46) 
i 2(n,-) ny 2(n, -1) n@ 
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£, + (2n, -1) f, + 2(n, -1) 





2n, (n,-1) 


Then the size of the interval between the two adjacent values 
is 


A 4 
T. -fT, (47) 


and if the size of this interval is normalized by dividing by 


the sample size, n,, and arbitrarily take 4 the result, then 


1 1 Ar oA 
a n; ( +7 2) 
{£ “on -1)£,+2(n,-1)} - {(2n.-3)£,+£ a 
ee i i i i i ae 
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is the continuity correction factor added. Notice that when 


f. = Q, which it will a large majority of the time because 


‘ae 1, the continuity correction factor reduces to 





1 
zai (49) 
Define 
Ty we 
T*=T +——— (50) 
- 1 2n_ 
i 
then it follows that 
k A 
gee it (51) 
i 
i=l 
(52) 





which may be combined in a probability statement similar to 


(34a) 


L-ap([s<s*+xK, o*] (52a) 


= p[ss S¥ a ] 


and the new lower 100(1 - a)% confidence interval, comparable 
to (36), is, 


k 


A 
l - qa = P/R 2 exp ) fy* = Ky 


P (53) 





i=l 
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and associated lower confidence limit is 


k 
R*¥ = exp/| - ) ty* = a 


S,L(a) (54) 





i=l 


the distribution of which is simulated as before for exactly 


the same ten cases, and the results are given in Table III. 


DISCUSSION OF SHAPE OF DISTRIBUTION 
WITH CONTINUITY CORRECTION ADDED 


Figures 5 through 8 below are identical to figures 1 
through 4, except that the simulated distributions plotted 
have the continuity correction factor added. There are no 
significant differences apparent; all four of the distributions 
with the correction factor added have essentially the same shape 
as their respective predecessors. All of the general comments 
made with respect to the first four figures also apply to these 


four, and they are presented for comparison purposes only. 


RESULTS OF ADDING THE CONTINUITY 
CORRECTION FACTOR 


The results of the same 30 cases, but with the continuity corr- 
ection factor added, are presented in Table III below. The 
results are compared with the Woods-Borsting Method in Table IV, 
and with the results before the continuity correction factor 
was added in Table I. 

Table III is almost identical to Table I, the only diff- 


erences being in columns (7) and (8), which are the mean and 
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variance of the new simulated distributions with continuity 
correction included, and in columns (9) and (10) where A* has 
been used to denote the a percentile of the distribution with 
correction factor included. Cases 1 and 6, which are identical 
except for the entry point into the random number generator, are, 
as in Table I, identical in column (10) for @ = .0§ and .10, and 
differ only in the third decimal place for a = .20. Cases l, 6, 
8,9, and 10 are very similar and should be compared to each 
other in reading the Table. Cases 4 and 7 are also comparable 
to each other. Cases 3, 5, 6 show the affect of the EP on the 
accuracy Of the procedure. 

The overall picture presented by Table III is much more 
encouraging than that of Table I. In nine of the 30 cases the 
measure Of accuracy (column (8)) was less than .01 and in two 
more was less than .0105, and considering the number of signi- 
ficant figures in the input parameters, the results are prob- 
ably not significant to four decimal places, so these two could 
be taken as equal to .01, giving 11 cases less than or equal to 
-Ol1. The average difference in magnitude between e“A* and R, 
was .017. For cases 3, 4, 7, 9, 10, the ones in which com- 
ponent sample sizes vary, the average difference was .012, a 
slight improvement. 

Table IV compares the results with the continuity correction 
factor to the results of the Woods-Borsting Method. This Table 
is identical with Table LI with the exception of columns (5) and 


th 
(7), where A* has been used, vice A, to denote the @ percentile 
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of the new distribution with correction factor added. As in 
Table II, the entries in the body of the Table have been rounded 
to two significant figures due to the nature of the input para- 
meters. The average error in column (7) with the continuity 
correction factor added is .017, and is significantly less than 
the average error of column (6), .036, for the Woods-Borsting 
Method. However, it is noteworthy that this high average is 
attributable to three large values. Taking away the three 
largest values from both column (6) and (7), the column averages 
become .023 and .021, respectively, which are insignificantly 
different. 

In Table VY the results obtained before the continuity 
correction factor was added are compared to the results obtained 
upon introducing the correction factor. The body of the table 
gives the number of cases for which the magnitude of the measure 
of accuracy was within the range specified in column (1). The 
sizes of intervals in columns (1) were so chosen because of the 
fact that IR, = exp(-A) | is only accurate to two places, even 
though computed to four places. For example, the four-place 
value .0142, when rounded off becomes .01, hence the choice of 
the second interval of .0051 to .0150. The addition of the 
continuity correction factor made a marked improvement in the 
results as can be seen both in the average value of the accuracy 
measure, 028 before, compared to .017 after, and in the in- 
creased number of cases that fall in the intervals representing 


the best accuracy. Before the continuity correction was added 
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COMPARISON OF COMPUTER SIMULATIONS WITH AND 
WITHOUT CONTINUITY CORRECTION FACTOR 
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only one-half the cases were within .025 of true system 
reliability, while after the addition of this correction, 25 
of the 30 cases had accuracy better than .025, Additionally, 
prior to the use Of the correction factor, there were three 
cases in which the accuracy was no better than .075, whereas 
upon adding the correction factor, there were no cases worse 
than .06. Based on these 30 cases it is amply apparent that 
the continuity correction factor improves the procedure 
considerably, and considering the fact that (52a) is an appro- 
ximate confidence interval, this procedure appears usable in 
situations where rough lower bounds on system reliability are 


permissible. 
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3- CONCLUSIONS AND ACKNOWLEDGEMENTS 


In this section the results of [1] and the results of this 
thesis are compiled together in Table VI, comparisons are made 
and results discussed. Secondly, general conclusions based on 
the entire thesis and recommendations for further investigation 


are made. 


TABULATION OF OVERALL RESULTS 

In Table VI are presented the results of computer simu- 
lations of four different approaches to the problem of obtaining 
a lower 100(1 - a)% confidence interval on system reliability. 
Two of the four are from [1], the well-known Poisson approxi- 
mation and the Woods-Borsting Method. The remaining two are 
the ones developed in this thesis, fitting a normal distribution 
to S, both with and without a continuity correction factor. 

Column (4), Y,, is the wa percentile of the simulated dis- 
tribution of a confidence limit involving a Chi-square random 
variable and based on the Poisson approximation to the Binomial. 
Inherent in this procedure the fact that sample sizes of all 
components must be equal, hence no entries can be made for cases 
3,.‘%, 7, 9, and 10. The rest of the column headings have been 
explained above, either in connection with Table II or Table IV. 
If all four methods were perfectly accurate, all the entries in 
columns (4) through (7) would exactly equal column (2). 


Notice how poor the Poisson approximation is in Case 5, a 


case where the P. are relatively small (see Table I), and in 
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TABLE VI 


COMPARISON OF COMPUTER SIMULATIONS WITH AND WITHOUT CONTINUITY 
VORREC TION FACTOR, POISSCN APPROXIMATION, 
AND WOOD-BORSTING METHOD 
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case 2. The procedures recorded in columns (5) through (7) 
also have places where accuracy is bad, but these occur for 
the most part in cases where @ = .05, which is to be expected, 
for the reasons mentioned in Section 3. From Table VI one can 
see that these three procedures display much more consistency 
in their accuracy than does the Poisson approximation method. 
The average error of the Poisson approximation is .049, and 
reiterating, the average errors for columns (5) through (7) 


are .036, .028, and .017 respectively. 


SUMMARY 
In the preceding three sections, an approximate lower 

100(1 - a)% confidence interval on system reliability has been 
developed, based on the procedure of [1], but differing from 
[1] in that the probability distribution fitted to § by the 
method of moments is normal rather than Gamma. The lower con- 
fidence limit of this confidence interval is a random variable, 
and in order to test the accuracy of the approximate confidence 
interval, the distribution of this confidence limit was simu- 
lated by digital computer, and its oth percentile compared to 
true system reliability. Figures 1 through 4 are histograms of 
four representative distributions; the reasons for their shapes 
are discussed. The level of accuracy obtained was not satis- 
factory, and hence a continuity correction factor was developed 
and added to the lower confidence limit. The distribution was 
again simulated by computer, the histograms of the same four 


distributions were plotted, and the oth percentiles of all 30 
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cases were compared to true system reliability as a measure of 
accuracy of the procedure. The changes in shape of the four 
distributions plotted were negligible. 

In conclusion, it appears that the method developed above 
by fitting a normal distribution to § without continuity corr- 
ection factor is no better or no worse than the method developed 
in [1] by fitting a Gamma distribution to cm Both have several 
large errors in accuracy, and both have average accuracy error 
on the order of .03. After the continuity correction factor is 
added the method of this thesis is certainly better than the 
same method before the continuity correction factor was added, 
as can be seen from Table V, and appears to be better, on the 
basis of average accuracy, than the method of [1]. However, 
in examination of Table IV, cases 4 and 8 have better accuracy 
by the Woods-Borsting Method, so one must conclude that neither 
of the methods is universally better than the other. It is not 
realistic to compare the method of [1] to the method developed 
above with continuity correction factor, because no correction 
factor has been added to the former, a point mentioned by, and 
currently under investigation by the authors of [1]. Another 
conclusion that cme as a by-product of this investigation is 
that one should use the Poisson approximation with great skep- 
ticism as the results are evidently not at all consistent in 
their accuracy. 

It appears that further investigation of this entire 


procedure is called for, and some recommendations as to the 
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paths this investigation should take are mentioned below. 
First, no variation in k, the number of components of the 
system, was made, and this is certainly a cogent area for 
exploration to see what effects this parameter has on the 
accuracy. Secondly, it would seem desirable to simulate a 
great many cases, with different combinations of the parameters 
k, Pi» Ry» with an eye toward devising a set of rules by which 
One could decide in advance which method would give the best 
results, dependent upon the parameters involved. It is im- 
possible to make any statements of this kind with only ten 
different combinations of parameters to examine. A third area 
for further investigation is one already mentioned in Section 2, 
that of investigating the error involved in truncation of the 
expression for the variance of S. 

I would like to thank Dr. W. Max Woods of the Operations 
Analysis Department of the U. S. Naval Postgraduate School for 
suggesting this problem to me, for allowing me to use the pro- 
cedure of [1] as a starting point, and for the helpful sug- 
gestions given me throughout the course of this investigation. 
I would like to also acknowledge the help of Dr. Rex H. Shudde, 
also of the Operations Analysis Department, for allowing me to 
use the computer program he developed for the procedure of [1], 
to which only minor modifications were necessary, and for the 


assistance in programming he gave me. 
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APPENDIX I 


DERIVATION OF T , THE UNBIASED ESTIMATOR OF T. 
L 


In Order that iy be an unbiased estimator of T it is 


7? 


necessary that 


a er 


Rewriting the above expression, using (6) and (8) 
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gq 
Then equating coefficients of qd; and or 
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Thus, 
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is an unbiased estimator of T;- 
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APPENDIX If 


COMPUTATION OF VARIANCE OF $ 
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The method of [1] for obtaining an approximate lower 100(1-2)% 
confidence limit on System Reliability is used, except, instead of a 
Gamma probability distribution, a Normal probabi lity distribution is 
used as the underlying distribution for §, the estimator of the negative 
logarithm of system reliability. 

An investigation is made of the errors involved in the truncations 
and approximations used throughout the development. A continuity 
correction factor is develoved, and confidence limits on system Telia- 
bility, resulting from computer simulation, are presented both with and 
without the inclusion of this continuity correction factor. 
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